A' Expr^fcail No. EJ778559587US 

Atty Dslfet No. AUT-P03/9914-2 

COMPARISON TABLE GENERATION AND DISPLAY FROM INSTANTIATIONS 

OF KNOWLEDGE MODEL 

The present invention relates to a knowledge-based, comparative information 
dissemination system having an architecture that separates the presentation of 
information from its organization in the system to enable a user to dynamically alter 
both the information retrieved and the format in which the retrieved information is 
5 displayed. 

BACKGROUND OF THE INVENTION 

*** It is common for companies to offer more than one benefit plan to their 
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employees. E.g., a company might offer different medical plans having different 
features and costs and different retirement savings plans having different payroll 
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y ] 10 deduction options. Although determining which plan best suits an individual 
p employee's needs can be a very complicated decision, new employees are typically 

m 

f== asked to enroll in a medical plan and a retirement plan on the day that they begin their 
CS . employment with the company. 

Further, although companies typically provide written materials describing the 
15 various plans, the benefits offered under the plans, and their respective costs, these are 
usually very complex legal documents that are drafted with an eye toward satisfying 
the vendor's full disclosure requirements, not toward educating the customer. 
Unfortunately, most companies merely distribute these printed materials provided by 
the vendors and make no provisions for an employee to make a simple comparative 
20 analysis of the available options. Thus, even if the employee is permitted a few days 
before being required to make an enrollment decision, in many cases the decision is still 
made without the employee understanding the differences between the offered plans or 
the impact that selecting one plan over another will have, given the employee's 
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particular needs and circumstances. Furthermore, if the new employee later decides 
that the selected plans and /or benefits do not best suit his needs, any subsequent 
changes may only be made during the annual enrollment period open to all employees. 
This could require an employee to wait up to a year to correct a poor decision made 
either in haste or with insufficient information. 

Regrettably, specific comparative information often is difficult to compile, even 
for trained benefits administrators, and requires significant extra work on the part of 
the domain experts to compile. In addition, even compiled information usually is 
difficult to understand for the employee who is generally unfamiliar with the employee 
benefits knowledge domain. Moreover, if such collected comparative information is 
maintained by the domain experts, it must be updated continuously as costs and 
features of the various plans change. 

An increasingly useful way for companies to collect, maintain, and disseminate 
such complex information is to use a knowledge-based system. Knowledge-based 
systems, also known as "expert" systems, are typically application programs that make 
decisions or solve problems in a particular subject area, referred to as a "knowledge 
domain," by using knowledge and analytical tools defined by experts in the field. By 
their very nature, expert systems are knowledge-intensive due to the goal of modeling 
human expertise in a domain. Such systems usually comprise two components: a 
knowledge base containing the information necessary to answer questions relevant to 
the domain and an inference engine to formulate answers to these questions, also 
known as "queries," based on the information contained in the knowledge base. Also, a 
user interface typically is provided to receive the queries from either a user or another 
application program, to submit these queries to the inference engine, and then to 
provide responses back to the user or other application program. Users of such an 
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expert system may include Human Resource (HR) personnel and individual employees 
themselves. 

Knowledge-based systems have been used in such diverse knowledge domains 
as engineering, the sciences, medicine, and business. Similar to numerical computer 
systems, they model situations and solve problems. However, and most importantly, 
knowledge-based systems also provide representation and reasoning capabilities that 
are not possible with most numerical methods. One specific example of these 
additional capabilities concerns the modeling of the knowledge possessed by human 
resource professionals in institutions such as government agencies or commercial 
^JIO companies. 

5 _ i 

pi There are currently many systems used by HR departments to answer employee 
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q\ and managerial questions about employee benefit plans and HR policies, procedures, 

Iji 

= and practices. These questions address issues such as how to use medical plans, take 

HI # leaves of absence, and file harassment complaints; as well as other issues such as 

t — - 

& h 15 paycheck withholding amounts, for example. 

C! - 

CI The information sources used to answer these questions in the typical 

organization usually reside in various formal and informal repositories. Some sources 
are static documents, both paper and electronic. These documents, which may or may 
not have been generated by the HR department, are designed to answer questions 

2G posed by employees. Other information sources include dynamic databases, such as 
the human resource management systems (HRMSs) that contain accounting 
information for each employee. Finally, some information resides only in the heads of 
the experienced HR professionals in the organization. These various and unconnected 
systems are the basis of most companies's HR information dissemination processes 

25 today, but there are problems with the underlying model for information 
dissemination. 
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First, pre-prepared, static documents are costly to produce. These document 
types include manually maintained policy manuals, summary plan descriptions, and 
web sites. Second, these document types tend quickly to become outdated, especially 
during major system or corporate reorganizations. Also, these resources often are able 
only to give general answers because more-detailed answers may vary depending on a 
particular employee's situation, such as employee group, physical location, age, and 
length of employment. 

In contrast, HRMSs, which are sometimes part of even larger enterprise resource 
planning systems (ERPs), contain vast quantities of accurate, constantly-updated data. 
fti 10 These dynamic systems, however, usually do not contain information on HR policies or 
on how to submit forms, for example. Thus, HRMSs tend to be able to answer 
questions seeking information from one data source (e.g., what is the net amount on my 
monthly paycheck), but not questions seeking information from a variety of data 
sources (e.g., I'm having a baby, what does the company do for me and what must I do 
M 15 to use these benefits). 

Other systems, such as electronic collections of answers to questions previously 
asked by other employees, are easy to search, but require significant resources to 
prepare and pose the same problems presented by static, prepared documents. These 
electronic question collection systems are likely to yield incorrect answers as a result of 
20* changes in company policies or system organization that would render previously 

correct answers incorrect. Not only is it tedious and difficult to identify and correct all 
of the affected answers following a change in company policies or system organization, 
it is even harder to verify that the changed answers are correct and complete. This is 
because the answers to such questions do not necessarily reflect the various data that 
25 were used to formulate the answers. It quickly becomes apparent that such systems do 
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not adequately address the deficiencies of other systems or serve as a useful 
information resource. 

Finally, although HR professionals themselves can be used to answer questions, 
such a resource is both expensive and inefficient. Using HR professionals to constantly 
answer repetitive questions, instead of performing other, more important aspects of 
their jobs, is not the best application of their skills and may result in the loss of talented 
HR professionals from an organization. In addition, finding the appropriate 
knowledgeable person to answer a question can be a frustrating and slow process for an 
employee. Furthermore, such resources may not be accessed by other computer 
applications, the way an electronic system may be. Thus, relying on HR personnel to 
provide employee information is not a productive option for any but the smallest of 
organizations. 

Consequently, knowledge modeling and delivery systems have evolved that 
combine pre-configured, parameterized models of human resource knowledge with 
organization and employee data. Such expert systems have successfully delivered 
personalized answers to employee and manager questions about benefit plans, payroll, 
HR policies, procedures, and practices using expert system inferencing techniques. 

However, in the advancement of knowledge systems generally, most of the effort 
has been directed to improving knowledge modeling and inferencing techniques in 
order to improve system reliability and the value of the information such systems 
provide to the user. Unfortunately, because of the limited commercial viability of these 
knowledge modeling and inferencing techniques thus far, insufficient effort has been 
expended to improve the delivery of information generated by the knowledge system to 
the user. However, if such knowledge-based systems are ever to be more broadly 
deployed, issues such as information presentation move to the forefront. 
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In the past, knowledge-based systems have generally employed one or two 
means to present the information drawn by the inferencing engine from the knowledge 
base. Most commonly, presentation of the information is dependent on how the 
knowledge in the knowledge base is organized. Domain experts inevitably mentally 
5 organize their knowledge differently from how various potential users might like to 
retrieve it. Thus, the domain experts often design and build a knowledge model of a 
domain that matches their mental organization of the domain, while different users of 
the model want to see the information contained in the model using alternative 
r% organizations. The typical solution — providing general and technical levels of 
jjl 10 responses — does not adequately meet a particular individual's specific information 

Ei 

fij needs in most situations. 



Recently, however, efforts have been focused on separating how the information 
is displayed from how it is stored in the knowledge base in order to present the same 
information in a variety of ways. However, problems continue to arise in the manner in 



vary from the form of presentation based on the nature of the information required. 

With reference to the specific example of expert systems that provide 
information on various plans and the benefits offered by each, it is not uncommon for 
an HR functional expert to create a presentation, such as a Web site or a manual, that 
20 describes each benefit plan. While the information presented seems to be complete and 
correct to the HR functional expert, when the presentation is referenced by an employee 
attempting to make a decision regarding in which plan to enroll, it is often very difficult 
for the user to coordinate and to digest the information. The information may be 
perceived by the employee as being overly technical and the key features, which the 
25 employee requires, may appear to be buried beneath other information that is irrelevant 
to the employee and /or fragmented into more than one location. Thus, not only is the r 




which information is presented to the user due to the fact that a given user's needs may 
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employee frustrated by the significant effort required to obtain the correct information, 
the employee can never determine with certainty that all of the relevant information has 
been retrieved. 

Moreover, other problems arise as a result of differences in the experience levels 
5 of the various users that such a system must accommodate. Some users know so little 
about the subject area that they fail to comprehend a given presentation, whereas other 
users, who may have had a great deal of experience in the knowledge domain, 
sometimes experience frustration in finding the M nuts and bolts" facts and details that 
they require. 

Cl 

ftilO Considering the example of an expert system that models the benefits offered by 
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a medical plan, the same manner of presentation cannot be used for an employee, a 
doctor's office, and a medical plan designer because their respective needs are so 
disparate. Yet, if multiple presentations are built for all possible users, it is burdensome 
n j to keep them all current when changes to the knowledge base occur. Also, when an 

jh= 15 employee has a life event such as marriage or childbirth, many pieces of information 

CI 

C) from many plans and policies need to be compiled in order for the employee to 

determine which plan best suits the new needs and whether an enrollment change is 
warranted. Consider again the specific example of a company that offers more than one 
medical benefit plan to its employees. The different medical plans will invariably have 
20 different features, such as specific physician participation, referral requirements, 
services covered, and costs, such as deductible, co-pay, and prescription amounts. 

The ideal comparative information distribution system would enable a new 
employee starting with the company to make an informed enrollment decision on the 
date of hire or shortly thereafter. The ideal plan would also enable enrolled employees 
25 to determine once a year during an open enrollment period if the plan in which they are 
currently enrolled will continue to best suit their needs in the coming year or whether 
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they should change their enrollment. In addition, the ideal plan would enable an 
employee to determine which information is most necessary to make the decision. 
Finally, the ideal system would provide these features to users while enabling plan 
administrators to organise the information resources in ways that are most 
5 comprehensible to them and are easiest to maintain. 

SUMMARY OF THE INVENTION 

Accordingly, it is an object of the present invention to provide a knowledge- 
based system that overcomes the deficiencies of currently available information 

yf|10 systems. 
Ul 

CI It is an additional object of the present invention to provide a knowledge-based 

ill 

Ul system having an architecture that separates the presentation of information from its 

yi 

organization in the system in order to provide multiple types of presentations of the 
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same information. 
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f ) 15 It is a further object of the present invention to provide a knowledge-based 
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i: system in which changes to the knowledge base are automatically reflected in the plan 
presentations. 

It is yet another object of the present invention to provide a knowledge-based 
system that enables a user to determine the format in which the pertinent information is 
20 displayed. 

It is a still further object of the present invention to provide a knowledge-based 
system in which information may be presented in a format best to show the differences 
between related classes of information, e.g., the costs and benefits of different medical 
plans. 
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It is another object of the present invention to provide a means of generating and 
displaying comparative information derived from related classes of information, e.g., 
the costs and benefits of different medical plans. 

It is yet a further object of the present invention to provide a means of generating 
and displaying comparative information derived from the same class of information, 
e.g., the costs and benefits of the same medical plan over different time periods, such as 
the current year and the following year. 

In its most general aspect, the present invention is directed to a comparison table 
generation and display technique for use with a knowledge-based comparative 

I J 10 information dissemination system. The system uses a knowledge model repository, 

n 

§;! which comprises multiple instantiations of at least one knowledge domain model. For 

example, in one anticipated implementation, the knowledge domain model is for 
^ l medical benefit plans offered by employers. The different instantiations correspond to 

n j different plans offered by that employer. Moreover, different versions of each 

M 

15 instantiation can be used to compare benefits and pricing for different time frames. The 

h 

q table generation and display technique of the present invention enables users to 

generate a comparison table containing information related to various features, benefits, 
and costs of different plans in such a way as to most easily compare the plans when 
making an enrollment decision. In addition, the table generation and display technique 

20 of the present invention enables users to generate a comparison table containing 
information related to the various features, benefits, and costs of the same plan over 
different time periods in such a way as to determine whether that plan will continue to 
meet their needs in the future. 

The table generation and display technique of the present invention is made 

25 possible by means of a compiler, such as a knowledge base engine, that is used to access 
the knowledge model repository and acquire information from the multiple 
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instantiations based on the queries and/ or parameters established by a user. A display 
process then combines the acquired information from the multiple instantiations in a 
tabular format to enable comparative analysis of the information by the user. 

In specific embodiments, the knowledge model repository comprises at least one 
5 human resource knowledge model. For example, the different instantiations of the 
knowledge model could comprise different benefit plans, such as medical and 
retirement benefit plans, or information related to the same plan, but over different time 
periods, e.g., the current year and the following year. In one implementation, 
information is contained in knowledge blocks that compose hierarchically-organized 

n 10 knowledge models. Such organization can further comprise major and minor 

i! 

:| categories of the knowledge blocks. 

In one embodiment, the display process presents the acquired information from 

1 the multiple instantiations in a table. For example, this table can have a first, horizontal, 

{ axis that has headings for the different knowledge model instantiations, such as various 

) 15 medical plans. A second, vertical, axis of the table may provide headings for different 

3 

knowledge blocks covered by the selected knowledge model instantiations. For 
example, the vertical axis can present information such as monthly costs, doctors's 
participation in the plan, prescription coverage, and claim processes for each of the 
different medical plans presented on the horizontal axis. 
20 Thus, a user can quickly determine the various attributes of certain classes of 

information, such as specific physician participation, deductible amounts for non- 
participating physicians, and copay amounts for a selected plan by reading down a 
column. Similarly, using the same table presentation, a user may quickly compare the 
differences between plans for the same class of information, such as copay amounts, by 
25 reading across a row. 
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Preferably, the table may be dynamically updated based on a user's preferences. 
For example, pull-down menus may be used to select among the different instantiations 
and selecting a new instantiation would automatically update the cells related to that 
new instantiation. 

The above and other features of the invention, including various novel details of 
construction, combinations of functions, and other advantages, will now be more 
particularly described with reference to the accompanying drawings and pointed out in 
the claims. It will be understood that the particular method and system embodying the 
invention are shown by way of illustration and not as a limitation of the invention. The 
principles and features of this invention may be employed in various and numerous 
embodiments without departing from the scope of the invention. 



In the drawings, like reference characters refer to the same components 
throughout the different views. The drawings do not necessarily present every 
component of the system, emphasis instead being placed upon illustrating the 
principles of the invention. Of the drawings: 

Fig. 1 shows a block diagram showing the organization of a knowledge-based 
information system according to the present invention; 

Fig. 2 is a schematic representation of a web page or HTML presentation 
showing the organization of a dynamically generated comparison table generated by a 
user of a knowledge-based information system according to the present invention; 

Fig. 3 illustrates a portion of a knowledge model from which the comparison 
table draws information; 

Fig. 4 shows a portion of the information repository that holds the variable 
assignments for each of the various instantiations of the knowledge model of Fig. 3; and 
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Fig. 5A shows a partial schematic of the interactivities of the knowledge model 
repository, instance repository, and runtime environment of the knowledge-based 
information system according to the present invention. 

Fig. 5B shows a partial exemplary schematic of the interactivities of the 
knowledge model repository, instance repository, and runtime environment of the 
knowledge-based information system according to the present invention implemented 
in the employee benefit context. 



Turning now to the drawings, Fig. 2 shows a web page or HTML presentation 
showing the organization of a dynamically generated comparison table that has been 
constructed according to the principles of the present invention. While the following 
discussion is specific to a system that provides human resource-related information, 
such as medical plan, dental plan, and optional insurance plan benefits, as is common 
with many expert systems, the principles of the present invention have wider 
applicability to such diverse fields as financial systems, enterprise management 
systems, supply-chain systems, insurance systems, corporate sales, manufacturing 
processes, and technical systems, to list a few examples. 

In a preferred embodiment, illustrated in Fig. 1, information is sent to the entity 
making the query using a combination of a conventional browser 106 and a 
conventional web server 107. In such an example, the server 107 and browser 106 
communicate via a TCP/IP network 109. Such a system has certain advantages in that 
established platforms and tools are readily available. In other implementations, 
however, proprietary interfaces could be used over public and/or private networks. 
Moreover, in still other implementations, the knowledge system may provide 
information to another application program, such as other human resource or 
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enterprise management systems, that has its own proprietary interfaces and displays. 
In such situations, the knowledge engine interfaces with the other application program 
via, in one case, standard application programming interfaces (APIs). 

In the present embodiment, the querying entity may be an employee seeking to 
answer personal questions concerning, e.g., his benefits or a manager seeking to answer 
such questions concerning the employees in her department. Alternatively, this system 
may also be deployed to enable HR professionals to generate queries and obtain 
answers in response to questions from employees seeking the information, e.g., in a call- 
center environment. In still other applications, the system may be invoked during a 
plan selection process by an employee to provide information to assist the employee 
with the plan selection decision. 

A knowledge engine or compiler 108 dynamically generates the HTML (Hyper- 
Text Markup Language) pages that are provided by the web server 107. These web 
pages are generated by referencing the relevant section of the knowledge model 
repository 101 and inserting information from the organization-specific and group- 
specific information repository 103 and HRMS 105 that functions as the employee- 
specific information repository. 

In one embodiment, the compiled information from the knowledge model 
repository 101, organization-specific information repository 103, and the HRMS 105 is 
then incorporated into HTML template pages contained in a presentation repository 
114. The resulting complete pages are provided by the web server 107 to browser 106. 
In other embodiments, the responses are interfaced with other applications and /or 
processes rather than directly with users. E.g., information can be transferred to a case- 
management or claims-processing system. 

The knowledge model repository 101 contains the various knowledge models 
created using knowledge modeling software application 102. In one embodiment, these ( 



# 



Atty D< 




No. AUT-P03/9914-2 
Page 14 



models are implemented either in an object-oriented or relational database system. 
Knowledge model repository 101 typically contains separate knowledge models for 
multiple plans, such as benefit plans for both hourly-workers and for salaried workers. 
The model for each of these plans, however, may be hierarchically-organized. 

The knowledge modeling software application 102 is a tool that is used to 
generate the knowledge models contained in knowledge model repository 101. This 
system tracks variable assignments and their location in the organizational and HRMS 
repositories. It also provides template rule organization tools for building the 
sequenced data entry screens that are used during system implementation for creating 
variable assignments. 

The organizational information collection software application 104 is a tool used 
by an HR system manager to accumulate information specific to the organization in the 
organization-specific information repository 103. In one embodiment, this 
organizational information collection software application 104 successively prompts the 
system manager to enter the information required by the system. The serial questions 
posed by the prompts are generated by accessing the associated variable prompts that 
are stored in the knowledge model repository 101. This process creates the various 
instantiations of the knowledge models, such as models of the specific medical plans 
covered by the system. 

In the example presentation of Fig. 2, information is provided to a user who is 
selecting or changing a health insurance plan. Specifically, the presentation provides 
answers concerning a user-defined selection of benefits offered next year by both the 
HMO Blue and Scrimshaw Catastrophic Medical plans, as compared to the user s 
current benefits under HMO Blue. The user may tailor the presentation in order to 
compare only those benefits that are of concern to the user. 
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Comparison table 200 shows information concerning different medical plans that 

has been generated by knowledge base engine 108 and supplied by server 107 to the 

user via web browser 106. A first, horizontal, axis 210 has headings 212A-212C 

corresponding to various aspects of the user's context, e.g., group instantiations, plan 

instantiations, or effective date instantiations. Specifically, the context relates both to 

plan instantiations (viz., the HMO Blue plan and the Scrimshaw Catastrophic Medical 

plan) and effective date instantiations (viz., this year and next year). In the preferred 

embodiment, the user may define the context by selecting the relevant knowledge 

model instantiation(s), preferably by selection from a menu of possible instantiations 

IJ 10 via pull down menus (accessed by activation points 218) in the headings. These pull 

down menus list several, or preferably most, or most preferably all of the different 

instantiations of the knowledge model. 

The second, vertical, axis 214 has headings for selected knowledge blocks 21 6 A- 

21 6G covered by the knowledge model instantiation(s) selected. Preferably, these 
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L 15 knowledge blocks are individually selected from a menu of possible knowledge blocks 

Ci 

q via pull down menus 220. For each cell, the compiler interprets the knowledge block 
specified by the row using the context including the knowledge model instantiation 
specified by column. E.g., cells 222A and 222B of table 200 display specific information 
concerning the relevant knowledge block for each instantiation selected. Cell 222A 
20 relates to submitting claims under the current HMO Blue medical plan and cell 222B 
relates to submitting claims under next year's HMO Blue medical plan. 

As illustrated by the exemplary presentation of Fig. 2, each comparison table is 
generated based on user-selected plans and plan features. The table presentation may 
be revised dynamically by the user in response to changes made to the plan and plan 
25 feature selections. 
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Fig. 3 shows exemplary knowledge blocks of which the knowledge model is 
composed. In the present implementation of the knowledge model, rules and text 
inferencing mechanisms are used to construct the cells in the plan comparison table by 
the knowledge engine. The example illustrates the Medical Plan Feature Overview 
5 knowledge block, which has a block ID of OVERVIEW, and the claim submission 
knowledge block. In this specific example, text is generated by the interpretive logic, 
through "if -then-else" statements, and also through strict substitution, where variables 
are located and replaced with variable assignments drawn from information repository 
103. It is important to note the separation between the presentation format and the 



4) 10 organization of the knowledge blocks in the knowledge model. Because the model 
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C| organization is divorced from the display format, the system is able to best serve both 
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zl the needs of the domain expert who designs the system and the user that relies on it to 
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obtain specific information. 
Si Fig. 4 shows an exemplary information repository 103. Specifically, variable 



there are different instantiations of the policy depending on the employee's employee- 
specific information, employer information, plan, employee group, and effective date. 
Thus, plan- and date-specific information is inserted into the knowledge blocks, and 

20 therefore the table presentation, to provide comparative analysis displays in a user- 
friendly fashion without artifacts from the knowledge-model's organization. Variable 
assignments may also be drawn from information contained in the company's HRMS. 

In addition to presenting the information in a fashion that is useful to a given 
system user, all various possible presentations are updated automatically when changes 

25 are made to the underlying knowledge model and information repository. Fig. 4 
illustrates the effect that changes to the effective date have on the same instantiation 




assignments are made according to a querying employee's employee-specific 



information, employer information, plan, employee group, and effective date. Thus, 
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(i.e., HMO Blue) and also the effect of changes in the instantiation (i.e., HMO Blue and 

Scrimshaw). Specifically, the current HMO Blue plan requires a $15 coinsurance 

payment per visit, in contrast to a $20 coinsurance payment per visit next year and a 

20% unlimited dollar amount under the Scrimshaw plan. 

Fig. 5A illustrates an exemplary portion of the interactivities of the constituent 
elements of the knowledge model repository, instance repository, and the runtime 
environment of a user. Fig. 5 B illustrates the same exemplary portion of the 
interactivities of the constituent elements of the knowledge model repository, instance 
repository, and the runtime environment of a user, as shown in Fig. 5A, as it might 
occur in the employee benefit context. 

It is important to note the possible differences between the comparison table 
structure and the knowledge block organisation structure in the knowledge model. 
E.g., the table shown in Fig. 2 could present different information related to the same 
medical benefit plans in response to user-initiated changes in plan and plan feature 
selections. Despite the different presentation options available to a system user, the 
plan comparison table references the same knowledge blocks in the knowledge model. 
In this way, the presentation may be organized for the user's ease of access, while the 
knowledge model may be organized for content authoring by a domain expert. 

While this invention has been particularly shown and described with references 
to specific embodiments thereof, it will be understood by those skilled in the art that 
various changes in form and details may be made therein without departing from the 
spirit and scope of the invention as defined by the appended claims. 




